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Introduction 



The graded response model represents a family of mathematical mod- 
els which deal with ordered polychotomous categories, that include: 

1. letter grading, A, B, C, D and F, in students’ performance 
evaluation; 

2. strongly disagree, disagree, agree and strongly agree in an attitude 
survey; 

3. partial credit given in accordance with an individual’s degree 
of attainment toward a problem solution; 

4. computerized cognitive diagnosis', etc. 

General Graded Response Model 

• Framework 

1. Operating Characteristic Pxg{^) • 

Conditional probability, given 9 , with which the individual 
with ability 9 receives a score Xg , that is, 

Px,{0) = prob.[Xg =Xg\ 9] , 



6 : latent trait (e.g., ability, attitude, etc.) that assumes 
any real number, 

g : an item, the smallest unit of manifest entity for 
measuring 6 , 

a graded item response to item g , with Xg (= 0, 1, trig) 
as its realization. 

2. Response Pattern V : 

A sequence of Xg for g = 1,2, ...,n , with its realization, v 
such that 

V = { Xi, X2, ..., Xg, ..., Xn y . 

3. Local Independence (Lord & Novick, 1968): 

It is assumed that within any group of individuals all char- 
acterized by the same value of ability 6 the distributions 
of the item responses are all independent of each other, that 
leads to: 

P^(0) = proh.[V = v\ 9] = n Px^O) , 

Xg€V 

Pv{6) : conditional probability, given 6 , for the response 

pattern v , also the likelihood function L{y \ 0) for V = v . 

o 
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• General Model 

1. Processing Function Mxg{0) (Samejima, 1995, 1997): 



pletes the step Xg successfully, under the conditions that: 

(a) the individual’s ability level is 6 , and i 

(b) the steps up to [xg — 1) have already been completed 
successfully. 

Assume that Mx^{0) is non- decreasing in 6 , indicating that 
each item has some direct and positive significance to the 
ability measured. 



for all 6 , indicating: 

i. everyone can at least obtain the item score 0 , and 

ii. no one is able to obtain the item score (nig + 1) . 

2. Fundamental Formula : 



Joint conditional probability with which the individual com- 




for Xg = 0 



( 1 ) 



= 0 for Xg = TUg + 1 , 



P.,(0) = n M,{9) [1 - 



( 2 ) 



S<Xg 



(Samejima, 1972). 
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. Cumulative Operating Characteristic (Samejima, 1995): 

Conditional probability with which the individual of ability 
6 completes the cognitive process successfully up to the step 
Xg or further. Thus 



Pf (^9) becomes the item characteristic curve (ICC), p,{») > 
when = 1 , i.e., in the general dichotomous response model. 
Pf^{9) is also non- decreasing in 9 , and from Eqs. (1) and (3) 



for all 0 . 

An alternative interpretation of Eq. (3) is that, assuming that 
the factors affecting the individual’s attitude toward Xg can 
be classified into two distinct tendencies: 

(a) being tentatively attracted by Xg , and 

(b) its simultaneous or later rejection (Samejima, 1972). 



= n M,{0) . 



( 3 ) 



S<X 



From Eqs. (2) and (3): 




( 4 ) 




for Xg = 0 



= 0 for Xg = nig 1 
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Homogeneous and Heterogeneous Cases 



• Homogeneous Case 

1. Family of models in which Px,{^) ’s for Xg = 1, 2 , rUg are 
identical in shape. 

They are positioned alongside the abscissa in accordance with 
the item score Xg . 

FIGURE 1: Example of a set of P*^(9) in the 
homogeneous case. 

2. General Formula: 




'0(t) dt , 



( 5 ) 



where 



oo — bo b\ b2 ^ bui^ bui^^i — oo , 



• some density function. 



: item discrimination parameter. 



bg : item score difficulty parameter. 
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3. Examples of Specific Models 
(a) Normal ogive model (Samejima, 1969, 1972): 




ag{6-bxg) 



[27r]i/2 



ragi,a- 

JaJB- 






(n.h \ 

g\^ ^Xg-\-l) Z 



( 6 ) 



FIGURE 2: Typical operating characteristics, Pxg{0) • 
FIGURE 3: M^^iO) ’s and ’s in the normal ogive 

model. 

(b) Logistic Model (Samejima, 1969, 1972): 

P ..s _ exp [-Dag{B - 6x,+i)l ~ exp [-Dag{e - 6^;,)] 

[1 + exp [-Dag{e - 6a;J]][l + exp [-Dag{e - b,;^+i)]] 

( 7 ) 

D : scaling factor, usually 1.7 . 

Rasch model is a special case of Eq. (7) when Dog = 1 . 
FIGURE 4: Mx^{0) and PxgW logistic model. 

NOTE: Birnbaum (1968) proposed the logistic model 
for dichotomous responses as a substitute for the normal 
ogive model. On the graded response level, however, these 
two models are substantially different in Mx^{0) . 



• Heterogeneous Case 



1. All models in which not all Pxgi^) identical in shape. 

2. Examples of Specific Models 

(a) Extended Bock’s nominal model: 

Bock’s nominal response model (Bock, 1972): 

P (0-. ^ expK, e + 

exp[aj 6 + /3J 

hg : a nominal response to item g . 

Hg : the set of all hg ’s . 
ochg{> 0) , (3hg : item response parameters. 





Samejima (1972) demonstrated that Bock’s nominal re- 
sponse model can be considered as a graded response model 
in the heterogeneous case, if hg in Eq. (8) is replaced by 
Xg , and 

0^0 < oil < 012 < ••• < Olmg , (9) 



where a strict inequality should hold, at least, at one 
place. 

Samejima did not pursue this further, for the reason that 
this model is based on the assumption that the conditional 



ratio, given 9 , of the probabilities of any two discrete 
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responses to item g is invariant regardless of the set of 
alternatives selected from the answer space: the same as- 
sumption used in the individual choice behavior (Luce, 1959). 
This is not acceptable in graded response situations in gen- 
eral. 

Later, however. Masters (1982) proposed his partial credit 
model and Muraki (1992) proposed his generalized partial 
credit model, both of which are special cases of Bock’s 
nominal model that satisfy Eq. (9) with a strict inequality 
everywhere. 

i. Masters’ partial credit model: 

= Xg + 1 for Xg =0,1,... ,mg . 

ii. Muraki’s generalized partial credit model: 



(Xxg = (Xg+l)ag for Xg = 0,1,..., trig 



(b) Logistic positive exponent family of models (LPEF) 
(Samejima, 1998b): 

PL{e) = [*»(»)]'•' . 



( 10 ) 



O 
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where 



1 + exp [-D ag(6 - ft)] 
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( 11 ) 



^Xgi> 0) : acceleration parameter. 

FIGURE 5: Examples of Px^{0) in LPEF. 



(c) Acceleration model (Samejima, 1995, 1997): 

. ( 12 ) 

^Xg (> 0) : step acceleration parameter. 

A family of models in which in Eq. (12) is specified 

by a strictly increasing, five times differentiable function of 
6 with zero and unity as its two asymptotes. 

E.G., Problem solving that requires a number of subpro- 
cesses before attaining the solution. 

Graded item scores, or partial credits, 1 through rUg , 
are assigned for the successful completion of separate ob- 
servable steps. 

E.G., 

1 + exp [-D a^^{6 - /3a; J] 
otxg (> 0) : step discrimination parameter. 

(3xg : step location parameter. 

Expanded LPEF for cognitive diagnosis, etc. 




Model Selection 



Desirable Features 

1. The principle and the set of assumptions behind the model 
should agree with the psychological reality in question. 

FIGURES 6 and 7: Similarities of the operating 
characteristics provided by two or more different 
models. (Masters’ partial credit model vs. acceleration 
model.) 

Figures 6 and 7 exemplify the fact that curve fitting alone is 
not a sufficient model validation. 

2. Satisfaction of the unique maximum condition 

(Samejima, 1969, 1972). 

This assures that the likelihood function of any response pattern 
consisting of such responses has a unique local or terminal 
maximum. 

FIGURE 8: Illustrative examples of likelihood functions that 
has a unique modal point and multi-modal points, 
respectively. 



Basic Function: 



A..(e) = ^ log />,,(«) = E 4 log M,(9)+-^ log[l-M(,,+i,(«)] 

S^Xg 

(14) 

(a) Axg{9) is strictly decreasing in 9 , and 

(b) its upper and lower asymptotes are nonnegative and non- 
positive, respectively. 

FIGURE 9: Examples of a set of basic functions in the 
extended Bock model 
(Masters’ model). 

Item Response Information Function: 

■ ( 15 ) 

Alternatively, the unique maximum condition is satisfied if 

Ixg{9) is positive for all 9 . 

3. The model should provide the ordered modal points of the op- 
erating characteristics in accordance with the item scores. 

A sufficient, though not necessary, condition: 

A(^xg-1){9) < Ax^{9) for Xg = 1,2, mg , 

for all 9 . 
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4. Additivity of the operating characteristics (Samejima, 1995, 
1997). 

The operating characteristics still belong to the same mathe- 
matical model under: 

(a) finer recategorizations, and 

(b) combinings of two or more categories together. 

FIGURE 10: Example of additivity (acceleration model). 
Graded item scores, or partial credits, are more or less inci- 
dental. 

E.G. 1. Letter grades. A, B, C, D, and F, are combined 
to pass-fail grades. 

E.G. 2. With the advancement of computer technologies, 
more abundant information can be obtained from the 
individual’s performance in computerized experiments 
as we proceed in research, and thus finer recategorizations 
of the whole cognitive process become possible. 

The criterion (a) leads to: 

5. Generalizahility of the model to a continuous model. 

TABLE 1: Evaluation of various models in terms of the 

above criteria. 
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Estimation of the Operating Characteristics 



• Parametric Estimation 

1. Multilog (Thissen, 1991): 

Direct expansion of Bock and, Atkin’s (1981) EM solution 
of the marginal likelihood equations for dichotomous responses 
for Samejima’s logistic model and Bock’s nominal response 
model and its extentions to graded response models. 

2. Parscale (Muraki and Bock, 1993): 

Essentially the same EM algorithm for the above models. 

• Nonparametric Estimation and Parameterization 

When the model has more than two item response parameters, 
as is the case with the LPEF, the acceleration model, etc., it 
is recommendable to use a nonparametric method of estimating 
the operating characteristics, such as Levine’s (1984) and Same- 
jima’s (1998a), and then parameterize the outcomes, using a very 
general semiparametric method, such as Ramsay and Wang’s 
(1993). 
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This will ameliorate the problem of indeterminancy of the esti- 
mated item response parameters. 
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NCME99: Figure 1 
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Normal Ogive Model; ag — 1.0 , = -1.50,-0.50,0.00,0.75,1.25 

(Taken from ONR/RR-79-4: page 18) 
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